DOCUMENT RESUME 



ED 061 728 



EM 009 715 



AUTHOR 

TITLE 



PUB DATE 
NOTE 



EDRS PRICE 
DESCRIPTORS 



I DENTIE.IERS 



Dunn, Walter L. 

Integration of Three New Teaching Techniques in an 
Introductory Computer Course, 

17 Jan 72 

1 2p„ * Paper presented at the ACADEMOS program at the 
Annual Conference, ASEE (United States Naval Academy, 
Annapolis, Maryland, June 22, 1971) 

MF— $ 0.65 HC— $3.29 

College students; Comparative Analysis; ’•‘Computer 
Science Education; Proctoring; programed Instruction; 
♦Teaching Techniques; Testing 
Fields Type Tests* Keller System 



ABSTRACT 



Three new teaching techniques, using established 
principles of learning, were combined to teach an introductory 
digital computer course to college students. The techniques wares 1) 
programed instruction; 2 ) Fields-type teaching tests, "a 
discrimination method to teach concepts by modifying the examination 
procedure to emphasize similarities rather than differences," and 3) 
the proctorial system of instruction (PSX) , or self-paced 
instruction. At the completion of the course, 86 percent of the 
students said they preferred this system to conventional lecture. 
Advantages of this method are that students appear to learn more, use 
of proctors is less expensive than use of instructors, and materials 
can be developed by the teacher while he is teachin the course. 
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r| Three new teaching techniques, using established principles of learnings 
were combined Spring Quarter 1971 to teach a three- credit Introductory digital 
. ; computer course to four sections (25 students in each) using tan student 
H proctors* One technique* first used alone In 1367, was Skinner- type programed 

tf 

|| or self-instruction,. The writer att ended the ASEE sponsored PI Workshop aft the 
^ University of Colorado during the summer of 1965, and worked three years 
developing a programmed self-instruction text^'. Used alone, students could 
and did learn She Fortran language, but the course was somewhat stale and 
motivation was lacking for soma students. 

The second technique used was developed by Dr. Paul E. Fields, Psychology, 
University of Washington, and is known as FI elds- type teaching tests (or 
questions) 1 * a A comprehensi ve set of Fields-type questions covering the 
language concepts of Fortran was written, tasted and rewritten In 1968. and 
1369a This technique was combined with programmed instruction- In 1069, and 
the two techniques have been used regularly since that time. To quote Dr. 
Fields, “The tests are a discrimination method to teach concepts by modifying 
the examination procedure to- emphasize similarities rather than differences, 
and by minimizing the possibility of a successful response by chance,;' 

Dr, Fields found, as did the writer, that 9055 of the students using the tech- 
| nlque Tike it, that grades can be assigned on perfection rather teen on the 
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"normal distribution" curve, and grades assigned are considerably higher than 
fes’ conventional techniques of teaching. Wif-h experience and skill, an 
instructor preparing such tests can consider performance or behavior objectives, 
criterion testes and can Incorporate important parts of the Skinner technique. 
{The Fields technique Is explained In detail in Dr. -Fields* text, as well is 
in three programed self-instruction units prepared by the writer*^'.) Although 



the questions require considerable tin'® and effort to prepare, a competent 
secretary can not only grade such tests , but can also rearrange the association 
items and retype them for subsequent use the following quarter. They are so 
constructed that they cannot ba memorized, so a set can be given to students to 
study; then, after rearranging, used again for testing. One of Dr. Fields-* 
findings was that frequent (weekly) testing Improved achievement, particularly 
for slew learners. 

The third technique integrated 'into the course was the proctorial system 
of Instruction (PSI), also called self-paced Instruction, and 'was developed 
by psychologists Fred S. Keller and T. 6, Sherman The writer attended a 
workshop conducted by .Keller, Koen» and Stice at the ASEE Annual meeting at, 

Ohio State University In June 1970 5 a second one at the ASEE Annapolis meeting 
In 1971 s and another one on the construction of behavioral objectives conducted 
by Dr, Edwin B, Kurtz at the University of Washington in February 1971. Unit 
objectives and assignments ware prepared and used with the PSX B incorporating- 
the prograt&Red text and the Fields technique during Spring Quarter 1971. 

Ten • student proctors (mostly undergraduate)^, each working six hours 
per week and receiving $2.25 par hour, were used for individual Instruction as 
requested by students, and for administering, grading,- and recording achievement 
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quizzes. The writer was given one- third fcima for managing or eoordlnating the 
instruction o and one instructor devoted half-time to general assistance and 
preparation of quizzes and the final examination.. At least two student proctors 
met with each section twice a week for 50-toinute' periods* Proctors were also 
available In scheduled rooms for administering quizzes three hours Tuesday 
morning and two hours Thursday afternoons* The Keller technique allows 
students to proceed at their own rate, turning in s computer program, taking 
the achievement qu1z e and receiving a grade of at least 90%' * on all work 
for each unit. Three sets of quizzes were prepared ’and used with each unit, 
and each set consisted of too parts i Cl) about 20 F ;ds»4ypa questions or?, the 
Fortran language, and. (2) construction of a flow chart and/or computer prograa. 

The point system for assigning grades was based ors 11 processed computer 
programs of 50 points each, 10 achievement quizzes at '50 points each, and a 
final exam of 200 points* Grades wars assigned on the basis of less than 
60% « Es up ‘to 69% - Da up to 79% - C, up t© 89% - B, and 90% op above « A* 
Grades eamed on this basis were: A *» 63%, B - 5% e C — 5%, D - 2%, E - 3%, 

passing withdrawals - 16%, incompletes - 7%, Students receiving lass than 
an A did not complete all of the units, although a few students . were taking 
the '’course pass-fall and did not attempt to complete all units. A passing 
withdrawal was allowed anytime during the quarter, and ‘the. 16% passing with-, 
drawals was about twice as high as for regular- classes.' 

Following is a summary of the evaluation of the. course, and the p'-ofessor 
which was made by 71 students* The writer feels this experiment, .using Fields 
technique," progmtmned self-ins tructi on s . and the Kail er PSJ.' was'. 86% successful - .’ 
based on the response to question #16* Eighty-si x percent of '-the students 1 

stated they p tSafi erred this system to conventional lecture. It Is believed 



that with several obvious Improvements, as wall 



as several 



suggested by students,, 



that the system can be at least 90% Successful, “ Questions 12, 13, 14, and 15 
were takers from similar questions asked by Or* Keller in one of his evaluations,, 
dots that only 3 to 4 students Indicated "less than" when comparing self-paced 



Instruction to the lecture method on each of .the four questions* Most students 
believed other courses could also be taught using the proctorial system as 
Indicated by question 17. 

A short evaluation form on the proctors was also completed, with students 
grading them A. 8, C e B, or E on sincerity* concern and Interest, competence, 
and a final grade for the course. All proctors received nearly Identical 
ratings, and the responses were mostly A 6 s with some B’s, end were higher than 
the grades received by the writer. 

Some ©f the things that need improvement (and more work) am: (1) the 
work load was to© much for three credits (and Is being changed to four); (2) 
soma of the Fields questions were airtblguous and need revision; (3) the unit 
objectives and «ss1gmr©nts were too variable in length, particularly the last 
few which were mush too long (the ten units have just been revised Into 18 units 
and espies are available from the writer) a (4) better security Is needed In 
administering quizzes as some cheating was reported by students ; (5) better 
overall organization ' and' coordination is needed (this comes with experience); 

(6) more discussions are needed with -proctors to’ make them aware of the "pressure 
from a few students. (The pressure was particularly heavy the last tew weeks 
of the, quarter when students were trying to complete all ten units.) 

What are the disadvantages of using .the techniques described with 100 
students? "'"The" primary one felt by the 'Writer was the loss, of 'direct contact, 
and the Inability to “know 11 25 students, and being able to call them by name 
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whan meeting anywhere on campus. Thera was also loss of ego and Importance 
in the classroom because the writer was not needed -there after the first few 
classes. The former "teaching” role became one of a manager* coordinators or 
an arranger of Instruction for TOO students* and to quote Dr. Kellers, he 
"arranges the contingencies of reward essential to the learning process.” 

The writer agrees with Dr. Keller that about 100 students and 10 proctors 
Is the limit for one Instructor to manage using the PSI. However* because the 
various teaching materials and method developed for this course over the 
last six years were cisnulative In results (and not. " forgotten *” such as after 
a lecture)* about $1*150 can be saved each quarter by using the proctorial 
system vrith 100 students. This Is based on the assumption that a full-time 
teaching lead for an Instructor making $1*500 per month# using conventional 
lecture* would require 1-1/8 Instructors and cost $6 S 000. Using tea proctorial 
system with one Instructor as a coordinator one-half time would cost $2*750; 
plus one secretary# one-half tin®* at a cost of $900 % ten proctors at 5 hours 
par week# $2.25 per hour# 10 weeks per quarters at $1*125; extra supplies at 
$75; for a total of $4*850. The amount saved is the difference between $6*000 
and $4*850# or $1*150 per quarter. In addition to the money savings most 
students like the technique better than conventional Instruction* and tee 
writer believes students learn more. 

Boas a professor Interested in improving the teaching-learning process 
have. to take a year or two off t© prepare such materials? Or can a teacher 
•Incorporate parts of these techniques each quarter or sanies ter? The answer to 
th© first question Is obviously ''yes# desirable* but ordinarily not possible.” 
The writer feels that small steps can be taken* using established principles 
of. learning^-. Professor Ed Kurtz suggests teat a start can be mads by a 
teacher who uses conventional lecture by taking. 15 minutes before each class? 
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to writs down bahav»or object! ves , and than preparing achlavesrant quizzes based 
on these objectives, the goal stated in his manual is; 

“You will ba able to construct Instruction for your collage courses 
that Is based on behavioral object! yes - what doss that mean 'in 
practical terms? It means that you will be able to write objectives 
for your lectures and also design the lectures so m to increase 
the likelihood that students will learn. It. also means that you 
will be able to write objectives , problems # and matching test. Items 
for printed materials such as textbooks » manuals# films* and other 
audio* visuals. It also means that you will be able to devise 
totally new mat'^lals* based on behavioral objectives* for group or 
Individualized Instruction. Whatever kind h f Instruction you want 
to use# you will be able to use objectives to build In It aceeunta- 

fb) 

faulty# and, hopefully# Increase student success. 

The writing of good behavioral objectives Is essential when using P52. 

The writer feels that good weekly 20 to 30 minute quizzes will do much 
to Increase achievement and help the teacher and student determine whether or 
not the behavioral objectives are being met* A start can also be- Raids by 
selecting a difficult topic within a course and developing good Instructional 
materials -far -it. Quite a few engineering professors throughout tea ’country 
have prepared sis. h materials end they should becoms available to others soon 
If proctors and secretarial assistance are not available the writer has 
modified the fell or technique by giving’ achievement quizzes- at one pans- 
.designated. time only# and. providing for one additional .quiz at .another -deslg- - 
nated tiros for those falling. This does require that each student get “ready 1 - 
for each achievement quiz wi thin a desi gristed perl od of time * us ual 1y one 
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week « which means some students might require as little as 5 hours while 
slow students Bright require 12 hours to prepare for the same unit. 

However* professors should have as their final goal the development and/ 
or adaption of the complete system. The basis of the Keller system* in stwanary* 
is that to modify behavior students (1) must respond (not Just listen)* (2) 
receive positive reinforcement* rather than negative* (3) progress at their 
own rate, (4) prove achievement and mastery with unit quizzes (which also pro- 
vides for feedback to correct mistakes and fill gaps)* (5) leant from written 
and visual materials rather than the spoken Word, (6) receive the material in 
relatively small logical parts* (?) have the use of student proctors for 
providing Individual assistance* and for administering,, grading and recording 
grades*. 



8 



SUMMARY ' 

EVALUATION OF COURSE AND PROFESSOR - GE ITS, Spring 1971 



Please check the appropriate box,* 

1, I believe the amount of work 
assigned for 3 credits was: 

2, I believe the number of achievement 
quizzes given was : 

3. I feel the number of computer pro- 
grams written and processed was: 

4. My feeling about the use of Fields- 
type teaching questions Is that they 
were: 

6. My feeling about the use of other 
short quizzes {flow charts and pro- 
grams) is that they were: 

6. My feeling about the Unit Assignments 
(Performance, Conditions, Criterion) 
is that they were: 

7. My feeling about the programmed self- 
instruction book used Is that it is: 

8. My feeling about the relevance of the 
material In this course as related to 
my future use Is that ft is: 



Section 

lyour name ", optional) 



! Too 

Little 


\ About 
! Right 


* - 1 

ioo | 

Much 1 




.L i tt -rr.^L 

31 “44% 


40-56% 


1-1% 1 


| 60-85% 


10-14% , 


3-4% 


36-51% 


32-45% 



Excel - 
1 ent 


1 Good 


r~ 

1 Fair 


j Poor 


1 

| Respar 




« * " ' ’ 


a . ... g 


I 


26-37% 


1 

I 

! 28-39% 


12-17% 


6-7% 


1-1% 

2-3% 


13-13% ! 


! ' 1 

! j 

I 44-62% 


f 

1 12-17% 


r^“ r ^ - 

2-3% 


■ i 

1 i 

16-23% | 


f 

1 

1 

! 42-59% 


10-14% 


2-3% 


27-38% 

' 


26-37% 


13-18% 


5-7% 


1 

• 

16-23% 


44-62% 


8-iif 


1-1% 



'IS The first number in each box Indicates the number of students answering tbs 
ERje questions, and the second number is the percent^?? students answering. 
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The grade I feel the professor earned for 
each of the following Is: 

9, Design, arrangement, organization 
of course: 

10. Techniques used In assigning grades* 

11. The final grade I assign the pro- 
fessor In charge of this course is: 



j .A 


C 


.. .D J E j 


41-58% 


24-34% 


4-5% 


1 ] 

2-3% ! ! 


45-64% 


21-30? 


4-5% 


i t 

1 - 1 % i f 


43-61% 


21 -30% 


Ct l 

6 

* 


\ ' 

t 

i \ 

1-1S 1 



12. X believe the amount of mastery 
(things actually learned) using 
the self -paced technique, as com- 
pared to the usual lecture method 
of Instruction was : 

13. I believe the feeling of achieve- 
ment using self-paced Instructions 
as compared to the lecture method, 
was : 

14. Insofar as recognition of the 
student as an Individual Is concerned, 
I feel that self-paced Instruction, 

as compared to the conventional 
lecture, was: 



15. The amount of enjoyment and satis- 




faction 1 received In taking this 




course by self spaced Instruction, 
as compared to the lecture method ^was i 



■■■■■“* J,1> 1 

Huch 

Greater 


Some- 1 
what 
Greater 


About i 
the | 
Same ] 


I Less 
1 Than 


24-34% 


30-42% 


! 

14-20% 


. 

3-4% 


25-35% 


30-42% 


13-19% 


3-4% 


29-41% 


24-34% 


13-18% 


4-6* 


31 - 44 % 


27-38% 


10-14% 


-• ' i. 

3-4% 



1ST 





1 - 1 % - 






16, If there was a choice, would you reconrnand to a friend that he or she 
take this course by: 

a. SZJ Conventional lecture, by a professor (10-14%) 

b. Q Self-paced instruction, using undergraduate proctors (61-86%) 

17. Do you believe other courses could and should be taught by self-paced 
instruction? If so, place a cheek in front of those you think you 
would prefer to take by this technique: 



□ 


other computer courses 


□ 


mathematics 


□ 


chemistry 




52-73% 






40-56% 




35-49% 


□ 


graphics □ 


physics 


□ 


English 


□ 


humanities courses 




19-27% 


32-45% 




13-18% 




10-14% 


□ 


social scinece 


area 












8-11% 












□ 


other: 













Please use the reverse side of this sliest to make any comments or suggestions., 
good or bad, about the questions above, or anything else, that will help to 
Improve this course. 



Ref ere n ces : 



CD 

CD 



Presented at the ACADEMGS program at the Annual Conference, 
States Naval Academy , Aiinapol $s 5 Mo, June 2^, r37I . 
INTRODUCTION TO DIGITAL COMPUTER PROBLEMS USING FORTRAN IV, 
McGraw-Hill Book Co., 1969. 



ASEE, United 
Walter L. Dunn 



(3) FIELDS TEACHING TESTS TO ACCOMPANY "PSYCHOLOGY AND LIFE, STH EDITION," 
Paul E. Fields, Scott, Foresmars end Co. : . 1971. 

(4} "How to Answer and Construct Fields Type Teaching Questions," Walter L. 



Dunn, unpublished. 

( 5 ) Good-bye Teacher. . . r JOURNAL OF APPLIED BEHAVIOR ANALYSIS, Spring, 
1968, I, pp. 73-89 . 

(6) Dr. Keller states peer teaching is effective because students who have 
just completed a course are better able to relate to and understand 
ouestlons of other students. He also believes that, in general, under- 
graduates make better proctors than graduate students. 

(7) Dr. Keller recommends "unit perfection as the basic condition of advance- 
ment, rather than a criterion such as 90%. In this particular course 
U was decided that minor mistakes, such as misplacing a heading on a 
computer printout by one or two columns . or omitting a parenthesis or 
period In a Fortran program (hand-written), were Insignificant Insofar 
as the objectives of the unit were concerned. 

(8) See also THEORIES OF LEARNING, 3RD EDITION, Mil gat'd, E, R. and Bower, \ 

G, H. , Appleton- Century- Crofts, Hew York, 19G6, pp. 562-565. 

(g ) CONSTRUCTING INSTRUCTION BASED Oil BEHAVIORAL OBJECTIVES, Walbesser, 

Kurtz, Gross, Robl, (Available from School of Engineering, Oklahoma 
State University, Stillwater, Oklahoma, 74074} 
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(10) Professor d, G. Sherman. Georgetown University, Washington, D.C, , is 
editing a PS I Newsletter as a clearinghouse for teachers who are 
Interested in or have developed topics or courses using the proctorial 
system. Anyone interested should write Or, Sherman, 




